How many speakers, how many texts - the automatic assessment of non-native prosody
نویسندگان
چکیده
We present an in-depth analysis of a method for automatically scoring the prosody of non-native speech. For studying its suitability for different application scenarios, we perform a systematic comparison of different evaluation schemes such as text (in-)dependence and/or speaker (in-)dependence. The focus lies on methodological issues, with the aim of promoting the careful evaluation of automatic assessment methods. Further contributions are the analysis of (1) a method that utilizes speaker IDs to improve performance, and (2) the analysis of performance as a function of the number of speakers and texts used for training the system.
منابع مشابه
Automatic Assessment of Non-Native Prosody by Measuring Distances on Prosodic Label Sequences
The aim of this paper is to investigate how automatic prosodic labeling systems contribute to the evaluation of non-native pronunciation. In particular, it examines the efficiency of a group of metrics to evaluate the prosodic competence of non-native speakers, based on the information provided by sequences of labels in the analysis of both native and non-native speech. A group of Sp ToBI label...
متن کاملTextual Engagement of Native English Speakers in Doctoral Dissertation Discussion Sections
Academic writing is no longer considered an objective and impersonal form of discourse. It is now seen as an attempt involving interaction between writers and readers; hence, academics are not only required to produce texts representing external realities but also to use language to recognize, build, and exchange social relations. The present study aimed to analyze how native English speakers, ...
متن کاملMetadiscourse Markers in the Discussion/Conclusion Section of Persian and English Master's Theses
Metadiscourse markers help writers make coherent and reader- friendly texts, thus of considerable importance in academic writing. The main aim of this study was to investigate how interactive and interactional metadiscourse markers are used by Iranian EFL learners. An inquiry was carried out to investigate cross-cultural similarities and differences in the use of metadiscourse markers in the Di...
متن کاملHow Many Labellers? Modelling Inter-Labeller Agreement and System Performance for the Automatic Assessment of Non-Native Prosody
On a database of non-native English productions annotated by 60 native English speakers as for their quality w. r. t. intelligibility, non-native accent, melody and rhythm, we study how inter-labeller correlation and performance of a regression system change when varying the number of labellers used for training. This depends highly on the difficulty of the labelling task, the features used by ...
متن کاملThe Prosody of Discourse Structure and Content in the Production of Persian EFL Learners
The present research addressed the prosodic realization of global and local text structure and content in the spoken discourse data produced by Persian EFL learners. Two newspaper articles were analyzed using Rhetorical Structure Theory. Based on these analyses, the global structure in terms of hierarchical level, the local structure in terms of the relative importance of text segments and the ...
متن کامل